Gaussian noise and time-reversal symmetry in non-equilibrium Langevin models 
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We show that in driven systems the Gaussian nature of the fluctuating force and time-reversibility 
are equivalent properties. This result together with the potential condition of the external force 
drastically restricts the form of the probability distribution function, which can be shown to satisfy 
time-independent relations. We have corroborated this feature by explicitly analyzing a model for 
the stretching of a polymer and a model for a suspension of non-interacting Brownian particles in 
steady flow. 
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I. INTRODUCTION 

The advances of experimental techniques have permit- 
ted the manipulation of single molecules and the study 
of their behavior under magnetic [1] and hydrodynamic 
forces [2|. These experiments have made it possible to 
analyze processes taking place at very short length scales 
and have opened new perspectives on applications of non- 
equilibrium statistical mechanics to small-scale systems. 
Although being under non-equilibrium conditions, many 
of these systems obey time- independent relations, or gen- 
eralized fluctuation-dissipation theorems, whose impor- 
tance has been stressed in a number of experimental sit- 
uations [1, 0, H, @]. It has been shown Q that these 
relations can be derived from the Onsager-Machlup the- 
ory Hi which assumes that the noise in the Langevin 
equation is Gaussian. In this work, we find that the rela- 
tions are a direct consequence of the time-reversal sym- 
metry principle. We show a theorem connecting both 
properties when the system is subjected to an external 
driving force. Our conclusion is that time-reversibility 
has important consequences on the stochastic behavior 
of non-equilibrium systems, leading in particular to re- 
strictions on the probability distribution. 

The paper is organized as follows: in Sec. UH we study 
Langevin equations in one dimension which have been 
used as a model for the stretching of single molecules 
and for the dynamics of colloidal particles in a translating 
optical trap. We also analyze the implications of time- 
reversal symmetries in such systems. In Sec. IIIII we con- 
sider the Brownian motion of non-interacting particles 
in linear two-dimensional stationary velocity fields, and 
compare the results with those of the one-dimensional 
case. In Sec. lIVI we briefly discuss Brownian motion in the 
nonlinear Poiseuille flow, and give concluding remarks in 
Sec. IV] 



II. LANGEVIN MODELS AND DETAILED 
BALANCE 

Many methods, such as scanning probe microscopy and 
laser optical traps, have been deviced to study the me- 
chanical properties of DNA, modular proteins or syn- 
thetic polymers by the extension of a single molecule [9] . 
In former of these methods, the tip of the atomic force 
microscope is subject to fluctuations. In the latter, the 
experiments on the stretching of single molecules are usu- 
ally done by attaching a polymer to two beads, one of 
which is kept fixed and the other moved by an optical 
tweezer. The moving bead is subject to thermal fluctua- 
tions due to the solvent medium, which is large enough 
to be undisturbed and considered as a thermal bath at 
a fixed temperature T. As such, the extension of the 
molecule can be modelled by an overdamped Langevin 
equation for the position of the bead 



■yx = -V'{x,t)+£(t), 



(1) 



where 7 is the friction coefficient of the particle, £(t) 
is an additive random force, V(x, t) is a potential and 
the prime denotes a space derivative. It is usual to con- 
sider the overdamped case since the low Reynolds number 
regime accounts for many situations, such as the motion 
of microorganisms and macromolecules in solution [7llic||. 
For the potential, we take 



V(x > t) = V (x)-H{t-t )Fx, 



(2) 



where H(t) is the Heaviside step function, to account 
both for the internal potential of the molecule Vo (x) and 
for a constant external driving force F, turned on at time 
to. Since the medium is in thermal equilibrium, it is 
common to assume that the random force is a Gaussian 
white noise with zero mean which obeys the fluctuation- 
dissipation relation 
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= 2ryk B T5(t-t), (3) 
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where kg is Boltzmann's constant. 

A driven system such as the dragged Brownian particle 
considered experimentally by Wang et al. [|[ can be mod- 
elled by Eq. {T]). In the experiment, an optical trap with 
a harmonic potential near the focal point is translated 
relative to the solvent with constant velocity v op t- The 
optical force acting on the colloidal particle at position x 
is given by F opt = — k(x — xq), where xq is the center of 
the trap. Therefore, in the laboratory coordinates, the 
system can be modelled by 



7± = -k(x - v opt t) + £(t). 



(4) 



By making a change of coordinates to the comoving frame 
xi = x — v op tt, the equation becomes 



j±i = -jVopt - kxi + £(t), 



(5) 



which has precisely the form of Eq. ([T]) with a potential 
of the form of Eq. J2]| . This system has also been studied 
in the formalism of the Onsager-Machlup theory [TJ [l^] • 
The Gaussian nature of the stochastic force has im- 
plications on the behavior of the system under time- 
reversal. In this case, it is possible to use the Fokker- 
Planck equation to describe the evolution of the prob- 
ability distribution P(x, t) associated to the stochastic 
processes given in Eq. (|TJ) 



= L FP (x,t)P(x,t), 



(6) 



where D — kpT/j, and Lpp{x,t) is the Fokker-Planck 
operator. The stationary distribution is given by 



P s (x,t) = Z - 1 e- v W k » T , 



(7) 



where Z is the normalization constant and the depen- 
dence on t comes from the step function and indicates 
only that there are two stationary states, depending 
on whether the force F is present or not. To sim- 
plify the notation, we will drop the t dependence from 
now on. The Fokker-Planck equation implies time- 
reversibility (HQ, which is given by the operator rela- 
tion 



L FP (x)P s (x) = P s (tx)L fp (tx), 



(8) 



where L FP (x) is the adjoint operator and time-reversal 
is indicated by r = 1 (r = —1) if a; is an even (odd) 
variable. 

On the other hand, it can be shown that time-reversal 
on the microscopic level implies that the random force is 
Gaussian. In general, the probability distribution P(x, i) 
evolves following the master equation 



dP(x,t) 
dt 



= / dx'[f(x\x')P(x',t) -f(x'\x)P(x,t)], (9) 



which can be written in the form of the Kramers-Moyal 
expansion [l5j 

^, E fc£f«y wn (io) 



Of 



dx 



where a n (x) are the moments of the transition probabil- 
ities T(x\x'), which can be shown, by using the additive 
nature of the noise, to be given by 



where 

f (x\x')-- 



f(x\x')=f (x\x')5(x-x'), (11) 



f,. w + f<zir Q „|L . (12) 



7 dx 



n=2 



Here, the a n 's are the cumulants of the stochastic 
force 7 -1 £(£), thus establishing a connection between a 
Langevin model and the Kramers-Moyal expansion. It is 
also possible to express the force V'(x) in terms of the 
stationary distribution as 



-V'(x) 



— r~ ar ' 



1 d 



,n — 1 



P s (x) dx r - 



which in the case of Gaussian noise simplifies to 

7-n*)=-fl>p s (*). 



(13) 



(14) 



the definition of a thermodynamic force [16l | . 

The condition of microscopic time-reversibility is given 

by 



f(x'\x)P s (x) =f(Tx\Tx')P s (x'), 



(15) 



where P s (x) = P s {tx). From here, it can be easily shown 
that the moments 



Tu 



dxdx'x l T(x\x')P s (x')(x' 



obey the symmetry relation [l] 



T, 



lm 



T 



ml • 



(16) 



(17) 



On substituting Eqs. (JUJl and $TBJ) into Eq. dTBJl and 

proceeding by integration by parts, one arrives at 



l+m 



T m i — —i — 



l + m- I 
n-1 



I - 1 

n - 1 



>l-n 



J.+m—n 



), (18) 



where 6j = 1 if j > and 6j = if j < 0. By applying 
relation (|17p to the moment with I — 1 and m — 2, one 
finds that 013 = 2ra3, and consequently 013 = 0. Then, 
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assuming that a„ = up to j — 1 and considering the 
moments with I = 1 and m = j — 1, one obtains 



= U - l)i 



(19) 



to conclude by induction that a n = 0, for n > 2 (for the 
case in the absence of an external force, see Ref. [13] )■ 
Therefore, time-reversal implies that the random force 
is Gaussian and that the Fokker-Planck equation is also 
valid in this case. 

The probability of observing a particle moving from 
x\ at time t\ to x n at time t n by any trajectory must 
be the same as the probability of observing the inverse 
trajectory in the equilibrium state 

P s {x n )P{x 1 ,t 1 \ ■ ■ ■ \x n ,t n ) = P s (xi)P(x n ,t n \ ■ ■ ■ |xi,ti), 

(20) 

where P{x±, t\ \ ■ ■ ■ \x n , t n ) represents the joint probability 
of being in the positions Xj at time tj. From here, we then 
arrive at the detailed balance condition 



P(x 1: ti\ ■ ■ ■ \x n , t n ) _ -[V(x 1 )-V{x n )]/k B T 

P(x n ,t n \---\xi,U) 



(21) 



which, despite being derived using the stationary prob- 
ability, is valid even if the system has not yet reached a 
stationary state, because it is a necessary condition on 
the dynamics of the system to guarantee that it reaches 
stationarity with the correct Boltzmann weights. 

The important aspect is that one is dealing with the 
dynamics of a potential system in which the transition 
probabilities depend only on energy differences. This can 
be seen from the fact that the Fokker-Planck operator of 
potential systems can be cast in the form 



(x) 



^ dx & 



V{x)/k B T 



d_ 

dx 



,V(x)/k B T 



(22) 



Before the external force F is switched on, the bead is 
in equilibrium fluctuating around the minimum of Vq (x) 
and satisfies relation (f2"Tj) . At the moment the force is 
turned on, the position of the minimum of the potential 
changes, the bead will no longer be at equilibrium and 
will take some time to relax to its new state of equilib- 
rium with a force [1 81 ] around the new minimum. How- 
ever, relation (j2Tj) continues being valid, but with the 
new potential, since it should be valid independently of 
the system being in an equilibrium or a non-equilibrium 
state. 

That this should be the case is not unexpected, since 
from the point of view of the trapped bead undergo- 
ing Brownian motion, the origin of the potential force 
is irrelevant. The particle always has a small probability 
of climbing the potential since its thermal motion never 
ceases and does not change by the switching on of the 
external force. From our point of view, it may appear 
strange that in pulling the particle in one direction it can 
move in the other; however, it is a natural consequence 
of the detailed balance relation. 

In the one-dimensional case studied thus far, there is 
always a potential if the force is a function of position 



only, which is not so for higher dimensions, when non- 
potential contributions may exist. 



III. BROWNIAN MOTION IN LINEAR FLOWS 

To illustrate the implication of the lack of a poten- 
tial, we consider the motion of particles in an infinite in- 
compressible liquid in stationary flow, taken to be small 
enough and to move at low velocities so as to not per- 
turb significantly the velocity field (small Pcclct number 
regime). In the presence of large friction, the inertial 
effects can be neglected. The probability distribution 
P(r; t) of spherical point-like colloidal particles in the 
liquid with velocity field v(r) can be calculated from the 
Smoluchowski equation [131 ] 



BP 

— + (v • V)P = DV 2 P 



(23) 



As noted earlier, in writing this equation, the assump- 
tion of Gaussian noise in the Langevin formalism is im- 
plicitly made. The corresponding equation is similar to 
Eq. ([1]), except that in this case it is a vector equation 
with the force term —V'(x,t) replaced by the stationary 
velocity field v(r). In this work we will address the class 
of planar stationary flows whose linear velocity field has 
components 

v x = Gy and v v — aGx, 

where G is a constant shear rate and a is a parameter 
that can range from —1 (pure rotation), through zero 
(simple shear) to 1 (pure elongation). In this case, it 
is possible to calculate analytically [19[ the distribution 
function P(r;t), for the initial and boundary conditions 

P(r,0) = S(r), and lim P(r, i) = 0, (24) 

r — >oo 

respectively. The solution is the conditional probability 
that a particle initially at the origin is at position r at 
time t, and is given by the generalized Gaussian 



a ( 2G \ 



exp ■ 



\aijj+(t)x 2 



where 



2x(*) 

^(t)y 2 - 2oi(a + l)<f>(t)xy\ } , (25) 

ip±(t) = (a + l)sinh(2a^Gi)±2c^(l - a)Gt, 
X(t) = DG _1 {(a + l) 2 [cosh(2a^Gt) - 1] 

-2a(a-l) 2 G 2 t 2 }, 
<j)(t) = cosh(2a^G£) - 1. 

It is interesting to notice that even in the presence of 
large fluxes the solution is Gaussian. Therefore, this is 
an example of a system which can be driven far from 
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equilibrium and still be characterized by Gaussian dis- 
tributions. The probability distribution obtained for the 
infinite system does not have a stationary solution, as 
can be seen by taking the limit t — > oo in Eq. (|25[) . which 
leads to 



lim P(r,t) = 0, 



(26) 



for all r. This is expected, since the velocity field consid- 
ered allows the particles to spread out without bound. In 
order to generate a stationary distribution, it would be 
necessary to confine the system to a finite region by us- 
ing reflective walls and/or to consider periodic boundary 
conditions (as in Couette flows between two cylinders). 
We show that even though the generalized Onsager rela- 
tions [201 ] are satisfied by the mobility matrix of a Brow- 
nian particle in all linear flows [2l[ , the time- independent 
relations are valid only when the velocity field is poten- 
tial. 



A. Elongational flow 

For elongational flow (a = I), the flux is potential and 
it is possible to write v = — V$, where 



®(x,y) = ~Gxy. 
The probability distribution function is given by 
\G\ 



(27) 



P(r;i) 



x exp 



2§7rD[cosh(2Gt) - l]l 



sinh(2Gi) 



-G 



AD |_cosh(2Gt) - I 



G 



( x + y ) + -^ x v 



which displays the time-independent relations 



P(x,y;t\G) P($) 



Gxy/D 



- 7 */fc B T 



P(-x,y;t\G) P(-$) 



(28) 



(29) 



together with all other similar relations obtained by 
transformations on x, y and G which maintain $ in- 
variant. These relations have the form of what has 
been named generalized fluctuation-dissipation theo- 
rems, since 7$ is the work done on a particle. It should 
be pointed out that this relation can be deduced from 
the detailed balance principle (j2"Tj) simply by assuming 
that the transition probabilities depend only on the en- 
ergy difference between the initial and final states, what 
is consistent with Eq. (|2"2")l . The reasoning goes as fol- 
lows: if the system is to have the Boltzmann weights in a 
stationary state, then detailed balance must be satisfied. 
Invoking the Markov property, a transition probability 
can be written as a product 

P(x a ,t a \x ,t \x b ,t b ) = P(x a ,t a \x ,t )P(x ,t \x b ,t b ). 

(30) 



Now, if the transition probabilities depend only on the 
energy difference, for the particular case in which E a = 
E + AE and E b = E - AE, we have 



P(X a ,t a \x Q ,t \x b ,t b ) 

P(x b ,t b \x ,t \x a ,t a ) 



P(x ,t \x b ,t b ) 
P(x ,t \x a ,t a ) 



(31) 



and Eq. (|29|) is deduced directly from here by using 
Eq. (|2lj) . It can be written as 



P(&E) _ AE/kBT 



P(-AE) 



(32) 



It should be noted that in performing Monte Carlo sim- 
ulations with the Metropolis algorithm, one of the re- 
quirements for a system to be able to reach the correct 
stationary distribution is precisely this relation (the other 
requirement is that the algorithm be ergodic) [22| . 

From the fact that the distribution function is normal- 
ized 



P(x, y; t) dxdy = 1, 



(33) 



and from Eq. 



we arrive at 



e-^ /kBT P(x,y;t)dxdy = 1 



(34) 

This last result is valid throughout the evolution of 
the system and in the stationary state (when there is 
one). Equations (|29[) and (j3~4"|) arc analogous to the 
the ones obtained by Astumian [7| for a single particle 
in a colloidal suspension in equilibrium in the gravita- 
tional field (23j and to relations known as generalized 
fluctuation-dissipation theorems (24J. 



B. Shear flow 

The case of a shear flow (a — 0) shows different fea- 
tures. Its probability distribution is given by 



P(r;t) = {AnDty 



x exp 



(Gf) 2 + 12 
3[ar- \yGtf 
Dt[(Gt) 2 + 12] 



j1\ 

ADt J 



(35) 



In this case, the ratio between the probabilities of sym- 
metric trajectories is no longer time-independent: 



P(x,y,t\G) 
P(-x,y;t\G) 



exp 



6Gxy 



D[{Gtf + 12] 



(36) 



Here, we notice the appearance of the potential of the 
elongational flow divided by a function of time in the ex- 
ponential. This can be understood by the fact that simple 
shear can be viewed as a composition of a rotation, whose 
vorticity destroys the potential nature of the flow, and an 
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elongational flow. For small times or small shear rates, 
if we expand the exponent to first order, this case will 
approximately obey the law found for elongational flow. 
However, as time passes, convection becomes important 
and the flow is no longer approximately potential. For 
large times, we can no longer make the time-independent 
approximation and the time-independent relations will 
not be valid. In this case, we cannot make the same rea- 
soning as in the former, which is due to the fact that 
no potential exists for simple shear. We can consider as 
an approximate experimental realization of simple shear 
the flow of fluid between two rotating coaxial cylinders. 
Since the flow does not contribute a potential energy, it 
is expected that at long times the distribution of Brow- 
nian particles P s (x,y) should become homogeneous. We 
should obtain from Eq. (|20p 



PQi,ti| ■ ■ ■ \r n ,t n ) 
P(r n ,t n \ ■ ■ ■ |ri,*i) 



1. 



(37) 



Instead, we obtain Eq. (|36p . However, in taking the limit 
t — > oo, we arrive at Eq. (|37p . so that at long times we 
recover the expected stationary result. 



C. Pure rotation 

The case of pure rotation (a = —1) has a distribution 
function identical to when there is no external velocity 
field 



P(r,i) 



1 



inDt 



exp 



x 2 + y 2 
4Di 



(38) 



which obeys Eq. (l37|) . as it should, since there is no po- 
tential involved. 



IV. BROWNIAN MOTION IN POISEUILLE 
FLOW 

Up to now, we have been dealing with linear flows. We 
will now focus on a nonlinear non-potential flow, which in 
a fixed coordinate system (x' , y') is given by the parabolic 
velocity profile 

< =7(^o- y 2 ): and 

< = 0, 

where 7 = V max /R 2 , Rg is the tube radius and V max 
characterizes the maximum velocity at the center of the 
tube. This nonlinear flow has a parabolic velocity pro- 
file, and in this case the distribution function cannot be 
obtained analytically. An expansion of the distribution 
for particles near the center of the flow has been calcu- 
lated making a change of variables to a translating 
system 

x" = x' - [x'(0) +v'(0)t'], and 



y'(o) 



and then considering the dimensionless parameters 
t = Dt'/yo, 

X = x"/x Q , 

y = y"/Vo, and 
a = iyl/D, 

where a is a local Peclet number. In these variables, the 
convective diffusion equation becomes 



dP/dt = V 2 P + a(2y + y 2 )dP/dx, 
with an approximate solution 

P = P + aPi + <r 2 P 2 + • • • , 
where the Pi's are given by 



Pi = p i (x 1 y,t)exp 



y 



it 



(39) 
(40) 

(41) 



The functions pi become more complex as we increase i: 
1 x(t + 3y + y 2 ) 



Po 



8(7rf)t 



Pi 



48(7rf)T 



(42) 



and for p 2 , which is an even function of x, see Ref. fljjj . 
For this case also, no time-independent relations such 
as (f29"T) can be found, as expected, since this is not a 
potential system. Instead, we obtain as an approximation 
for small a 



P(x,y,t) 



1 + 2(7 



Pi , 2 P 1 



P(-x,y,t) - ' "P 

x(t + 3y + y 2 ) 
= 1 — a 



P 2 




x(t + 3y + y 2 ) 
6 



(43) 



If <7 = 0, Eq. (|39|) reduces to a diffusion equation and 
has a Gaussian solution; however, if a 7^ 0, then the 
solution will not be Gaussian, independent of whether a 
is small or not. Therefore, this illustrates a simple case 
of a system which may be very close to equilibrium but 
that displays non-Gaussian behavior of the probability 
distribution function. 



V. CONCLUSION 

We have studied model one-dimensional systems and 
a two-dimensional system composed of noninteracting 
Brownian particles and a liquid driven to a steady state 
by external forces in thermal equilibrium. Although the 
flow conditions are steady, the colloidal particle distri- 
bution may not have a steady distribution as is the case 
of a colloidal suspension in an infinite region. Notwith- 
standing, in potential systems, some time-independent 
relations can be found. 

We demonstrated that the same kind of time- 
independent relations that appear in experiments with 
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single molecules are present in Brownian motion in elon- 
gational flow. By showing that the origin of these re- 
lations is microscopic reversibility and the existence of 
a potential, we conclude that such relations are natu- 
ral consequences of the thermodynamics of potential sys- 
tems, even when considering nonequilibrium states. 

We also show that the Gaussian nature of a distribu- 
tion is not necessarily related to equilibrium conditions. 
Even though the external driving force may be large, 
keeping the system in a far from equilibrium state, the 
distribution can be Gaussian nonetheless. We pointed 
out that the linear character of the flow is more important 
to Gaussianization than the equilibrium (or nonequilib- 
rium) state of the system. This was seen in the fact that 
even though the external driving in Pouseuillc flow can 
be small, the distribution function will not be Gaussian. 
On the other hand, in the linear cases, such as elonga- 
tional flow or simple shear, the fluxes may be large and 



the distributions still be Gaussian. 

In summary, we have shown the implications of the 
Gaussian nature of the noise in the stochastic behavior 
of non-equilibrium systems. Even in systems subjected 
to strong external forces, as in the stretching of single 
molecules, the process is carried out in a solution that 
serves as a thermal bath held at constant temperature 
and, therefore, there is no reason for the noise to be other 
than Gaussian. That, together with the potential nature 
of the system, leads naturally to the pervasive presence of 
time-independent relations in non-equilibrium systems. 



Acknowledgments 

This work was supported by the DGiCYT under grant 
no. FIS2005-01299, by CNPq and by CAPES. 



[1] S. B. Smith, L. Finzi, and C. Bustamante, Science 258, 
1122 (1992). 

[2] T. T. Perkins, D. E. Smith, R. G. Larson, and S. Chu, 
Science 268, 83 (1995). 

[3] G. M. Wang, E. M. Sevick, E. Mittag, D. J. Searles, and 
D. J. Evans, Phys. Rev. Lett. 89, 050601 (2002). 

[4] D. M. Carberry, J. C. Reid, G. M. Wang, E. M. Se- 
vick, D. J. Searles, and D. J. Evans, Phys. Rev. Lett. 92, 
140601 (2004). 

[5] X. D. Shang, P. Tong, and K. Q. Xia, Phys. Rev. E 72, 

015301(R) (2005). 
[6] F. Douarche, S. Joubaud, N. B. Gamier, A. Petrosyan, 

and S. Ciliberto, Phys. Rev. Lett. 97, 140603 (2006). 
[7] R. D. Astumian, Am. J. Phys. 74, 683 (2006). 
[8] L. Onsager and S. Machlup, Phys. Rev. 91, 1505 (1953). 
[9] K. Wang, J. G. Forbes, and A. J. Jin, Prog. Biophys. 
Mol. Biol. 77, 1 (2001). 
[10] E. M. Purcell, Am. J. Phys. 45, 3 (1977). 
[11] R. D. Astumian, cond-mat/0608352. 
[12] T. Taniguchi and E. G. D. Cohen, cond-mat/0605548. 
[13] H. Risken, The Fokker-Planck Equation (Springer- 



Verlag, Berlin, 1989). 
[14] H. Qian, M. Qian, and X. Tang, J. Stat. Phys. 107, 1129 
(2002). 

[15] N. G. van Kampen, Stochastic processes in physics and 
chemistry (North-Holland, Amsterdam, 1992). 

[16] S. R. de Groot and P. Mazur, N on- equilibrium thermo- 
dynamics (Dover, New- York, 1984). 

[17] P. Mazur and D. Bedeaux, Physica A 173, 155 (1991). 

[18] D. ter Haar and H. N. S. Wergeland, Elements of Ther- 
modynamics (Addison- Wesley, 1960). 

[19] R. T. Foister and T. G. M. van de Ven, J. Fluid Mech. 
96, 105 (1980). 

[20] J. W. Dufty and J. M. Rubf, Phys. Rev. A 36, 222 (1987). 
[21] J. M. Rubf and A. Perez-Madrid, Phys. Rev. A 43, 7040 
(1991). 

[22] N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, and 
A. H. Teller, J. Chem. Phys. 21, 1087 (1953). 

[23] S. Chandrasekhar, Rev. Mod. Phys. 15, 1 (1943). 

[24] G. N. Bochkov and Y. E. Kuzovlev, Physica A 106, 443 
(1981). 



